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Abstract 

We here present a fixed agents version of an original model of 
the emergence of hierarchies among social agents first introduced by 
Bonabeau et al. Having interactions occurring on a social network 
rather than among 'walkers' doesn't drastically alter the dynamics. 
But it makes social structures more stable and give a clearer picture 
of the social organisation in a 'mixed' regime. 



1 Introduction 

A number of models in socio- and econo-physics are inspired from 
magnetism, starting with the pioneering work of Follmer (1974) [I]. 
They concern the modeling of opinion dynamics and assume for in- 
stance binary opinions of agents distributed on some social networks, 
with variants which include the mean field approximation. Agents 
adjust their opinion under the influence of their neighbours. In many 
models, agents follow the opinion of their neighbours via for instance 
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some "voting" scheme: an agent would then check the opinions of 
its neighbours and adjust its own opinion according to the majority's 
opinion. The observed dynamics resemble ferromagnetism. 

But a large number of other models start from the opposite as- 
sumption. 

In the minority game [2J, applied to financial markets, agents 
choose to behave in opposition with the majority: if the others are 
buying, you should sell (and the opposite). The minority game is only 
one of such models to which one can relate the model of the emergence 
of social classes based on the ultimatum game of Axtell et al [3], and 
Bonabeau et al model [1] of the emergence of social hierarchies. This 
Bonabeau et al approach, followed by the contributions of Ben-Nairn 
and Redner [5] (taking a mean field approach) and of Stauffer [6], is 
the original inspiration for the work presented here. 

We consider agents i whose internal state h(i) is adjusted on the 
occasion of binary encounters. h(i) can be interpreted as strength and 
encounters as fights. On the occasion of a fight, the winner, usually the 
stronger agent, wins and its strength is increased by one. The looser 
strength is decreased by one. By usually, we imply a probabilistic 
process with some "thermal" probability. Bonabeau et al original 
model is a walkers' model: agents are moving across a square lattice, 
and interact only when they encounter on the same lattice site. The 
main parameter of these models is the (3 discrimination parameter for 
the outcome of the fight process. In Bonabeau et al a phase transition 
is observed: at low f3 values, a "disordered" phase is observed with 
a Gaussian distribution of agent strengths, while at high (3 values, a 
large fraction of agents have extreme strength, positive or negative. 
Several variants yield a sharp phase transition, but under questionable 
assumptions. In Bonabeau et al, strength is allowed to go to infinity 
with time. In Stauffer's model [6], when a moving average process is 
introduced to limit strength, the transition is not sharp; Stauffer had 
to introduce some extra dynamics on the (3 discrimination parameter 
to get a sharp transition. The first motivation for the present research 
was to check the importance of the random "walkers" dynamics on the 
sharpness of the transition: would fixed agents, at the nodes of a social 
network, display a sharp transition towards some " anti- ferromagnetic" 
regime? 
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2 The model and its numerical imple- 
mentation 



We use a square lattice with periodic boundary conditions. Agents 
don't move and remain at lattice nodes. At each time step, an agent 
i, randomly selected, updates its internal variable hi(t) through a ran- 
dom process. The agent interacts with one of its four neighbours ran- 
domly chosen. He wins with a probability P related to its neighbour's 
strength by a logit (or thermal) function according to: 

(1) 



1 + exp(J3(hj(t) -hi(t)) 

As in thermal physics, a large (3 coefficient results in a nearly deter- 
ministic choice in favour of the stronger agent, and in a nearly random 
choice when j3 is small. As a result of the interaction, the winner's 
strength is increased by one, and the looser strength is decrease by 
one. Suppose, e.g., that i wins, the updating gives: 

hi{t) = (l- 7 )^(t-l) + l , (2) 
= (l- 7 )Mt-l)-l • ( 3 ) 

These equations correspond to a moving average of past gains. 
Gains increase strength, but past gains are discounted at a rate 1 — 7. 
I/7 is the characteristic time of the dynamics. They imply one double 
update, since two sites i and j are involved; one time step corresponds 
to one double update per site. 

We usually start simulations from a configuration where all strengths 
are 0, and run them for a long time to check the attractors of the dy- 
namics. A typical time scale for the simulation is IO/7 updates per 
site, i.e. ten times the characteristic time. This choice is also mo- 
tivated by the equilibrium amplitude of the strength of a constant 
winner: 

h(eq) = (1 - j)h(eq) + 1 (4) 

h(eq) = - (5) 

7 

Times proportional to I/7 are needed to allow strength to saturate. 
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Figure 1: Standard deviation of the winning probability distribution as a 
function of /3, observed at 7 = 0.1 for networks of size 100 x 100 and 200x200. 
Simulated were 10 000 time steps. 



3 Simulations results 

Apart from the dimension of the lattice which might give rise to some 
size effects, two parameters control the dynamics, f3 the discrimination 
parameter and 7, the memory parameter. Our simulations display the 
system configuration at asymptotic time value or some kind of order 
parameter. 

We have chosen the same order parameter as Bonabeau et al and 
followers, namely the standard deviation of the distribution of the 
probability to win, a. We first checked at fixed 7 the evolution of a 
versus (3, the discrimination coefficient (figure 1). 

The observed crossover, starting at values of f3 close to 7 is smooth 
and no size effect is detectable between networks of size 10,000 and 
40,0000 which could account for the observed smoothness. We also 
checked, for the same reason, the influence of convergence times which 
again is not noticeable after a number of double updates per agent 
above IO/7 time steps (not represented here by a figure). 
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Figure 2: Standard deviation of the winning probability distribution as a 
function of j3/j, observed for networks of size 100 x 100. 7 values are 0.05, 
0.1 and 0.2. Simulation times per site are IO/7. 



To check the influence of both (3 and 7 it is interesting to use a 
reduced parameter. /3/7 is a good candidate, by analogy with fer- 
romagnetism. The mean field theory of ferromagnetism predicts a 
transition when (3 = z x J, where J is the coupling constant and z 
the number of neighbours. We expect then 'something' to happen 
as a function of Another model based on a logit choice and a 

moving average of a utility function based on past experience is Weis- 
buch et al model of Marseille fishmarket [7] which also gives /3/7 as a 
reduced parameter. I/7 being the characteristic strength involved in 
the present problem, /3/j is then a reasonable choice. 

Figure 2 displays the standard deviation of the distribution of the 
probability to win, a, as a function of /3/7, 

As we guessed, the onset of a smooth crossover occurs slightly 
above = 1 where the three curves meet. And a saturates at 0.5, 
which corresponds to all probabilities equally distributed between the 
two values and 1. But the function a vs. is not universal: the 
slope of the line near the crossover seems to increase with decreasing 7. 
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Figure 3: Normalised averaged strength amplitude \h\ x 7 as a function of 
/3/j, observed for networks of size 100 x 100. 7 values are 0.05, 0.1 and 0.2. 
Simulation times per site are IO/7. 



The Bonabeau et al result, a vertical transition for infinite strength, is 
then consistent with ours for small 7. The same is true for Stauffer's 
result: no sharp transition for finite strength values. In other words, 
our fixed fighters results are consistent with those obtained for walking 
fighters models. 

A similar behaviour is observed in figure 3 for the relative average 
amplitude of sites strength, another possible order parameter. At 
large /3/7 values, strength amplitudes saturate to I/7. The curves 
cross around /?/7 = 1, but they don't collapse. 

The histograms displayed in figure 4 provide a more direct repre- 
sentation of the state of the system at different (3 values. Strengths 
vary between +10 and -10, respectively ±1/7. In the low (3 region, 
say j3 < 7, the strength distribution is a Gaussian centered around 0. 
By contrast, when (3 S> 7, two narrow peaks are observed at ±1/7. 
In between the transition is smooth. 

Figure 5 is a set of 50 x 50 strength patterns obtained after 10 000 
time steps for different values of (3 below and above I/7. 
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Figure 4: Strength distribution as a function of (3, observed for networks of 
size 100 x 100. 7 = 0.1. Simulation times were 100 000 time steps. 




Figure 5: Strength patterns obtained on 50 x 50 lattices after 10 000 time 
steps for p = 0.11, 0.15 and 0.3; 7 = 0.1. Black corresponds to -10 strength, 
grey to intermediate values, and white to 10 strength. When (3 increases from 
to 0.3, 'anti-ferromagnetic' islands with checkerboard structure increase in 
size and invade the whole lattice 
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The checkerboard pattern obtained when (3 = 0.3 is a clear picture 
of the analogous of an " anti- ferromagnetic" configuration: all sites 
have a maximum strength I/7, alternately positive and negative. For 
the intermediate values of (3, anti-ferromagnetic islands of size increas- 
ing with (3 invade a sea of low-strength sites coloured in grey. At inter- 
mediate (3 values, the checkerboard islands do not grow in time since 
the low strength agents at their boundary have one neighbour within 
the checkerboard structure against 3 outside. They tend to relax to- 
wards the average strength after their interactions with checkerboard 
sites. 

This intermediate regime can be compared to type II supercon- 
ductors which also exhibit a mixed regime between two values of the 
external magnetic field, where magnetisation increases continuously 
with the field. In the mixed regime, 'normal' vortices regions are sur- 
rounded by superconductive regions. 

As observed in figure 6, the time evolution of the patterns in the 
anti-ferromagnetic region implies two characteristic times: first, ferro- 
magnetic domains separated by low strength lines appear quite fast. 
Two domains separated by a line are shifted by one site; in one di- 
mension the structure would be: 

+-+-+-+0-+-+-+-+- 
(where + is positive, - negative and weak strength). The two an- 
tiferromagnetic domains are phase shifted by n with respect to the 
lattice structure. 

The subsequent annealing process with coarsening of anti-ferro- 
magnetic domains into a unique domain is much longer. 

The online observation of the sites dynamics shows that two factors 
account for the slow convergence dynamics and for the finite width of 
the crossover: 

• The structuring process into antiferromagnetic patches begins 
early in time and when (3/ 7 ~ 1. But patches growing from 
different regions of the lattice don't have any reason to be in 
phase. Whenever intermediate strength (h ~ 0) agents interact 
against agents from the antiferromagnetic patches, their strength 
is increased (in absolute value) by interaction with one side but 
it is decreased when they interact with the other side. 

• Since the strength difference between intermediate agents and 
agents inside patches is half of the strength difference inside the 
patches, a higher [3 value is necessary to maintain long range 
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Figure 6: Time evolution of strength patterns obtained on 50 x 50 lattices for 
(3 = 0.3 and 7 = 0.1, after 1000, 5000 and 8000 time steps. The colour code 
is the same as above. One first observes a fast evolution towards a partial 
anti-ferromagnetic structure with low strength line boundaries. Annealing of 
the boundaries takes a longer time and is achieved after 10000 time steps as 
observed in the previous figure. 

order. 

Finally, figure 7 returns to the question posed already by Fig. 2: 
Would we get for 7 — ► a sharp phase transition in the sense that the 
slope of a versus the ratio /J/7 would become infinite at some critical 
value of this ratio? For this purpose we simulated much larger lattices, 
for at least IOO/7 time steps and 0.001 < 7 < 1. We also used regu- 
lar updating, instead of the above random updating, and made minor 
changes. There are long-time effects preventing complete equilibra- 
tion, presumably due to reptation of domain boundaries. Nevertheless 
this figure confirms our guess from Fig. 2 about a sharp transition in 
the limit 7 — ► 0. The critical ratio /J/7 seems to be 1. 

4 Conclusions 

Our first aim was to compare a fixed agents model of 'fighters' with 
results obtained for 'walkers' models of Bonabeau et al. We wanted to 
know whether the smoothness of the crossover observed when strength 
remains finite was due to the extra randomness introduced by walkers 
diffusion. We demonstrated that a fixed agent model also displays a 
smooth crossover. 

The observation of equilibrium patterns shows that small anti- 
ferromagnetic domains start to develop in the intermediate mixed re- 
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Figure 7: Maximum slope (+,*), of the a versus (3/^y curves like figure 2, on 
1000 x 1000 lattices for IOO/7 (+) and IOOO/7 (*) time steps. The x symbols 
indicate the ratio (3/ 7 for which this slope is reached. 

gion, when (3 ~ 7, but infinite long range order is only achieved for 
values of the discrimination parameter (3 above the onset of the mixed 
region. The width of the mixed region appears to increase with 7. 

Interpretations of the lattice in terms of social networks show that 
the hierarchy is re-enforced by the fact each agent interacts with the 
same neighborhood. On the other hand, social networks are more 
random than lattices. They are not totally random as Erdos-Renyi 
nets and display more betweenness (small loops), than regular lat- 
tices. But the stability of the ordered regime obtained with square 
lattices containing only non-frustrated loops cannot be expected from 
more random structures: frustrated loops introduce glassy dynamics, 
with wider crossover and more irreducible fluctuations in the ordered 
regime. 
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